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Abstract 

In this paper the simplicial cone constrained convex quadratic programming problem is 
studied. The optimality conditions of this problem consist in a linear complementarity prob¬ 
lem. This fact, under a suitable condition, leads to an equivalence between the simplicial cone 
constrained convex quadratic programming problem and the one of finding the unique solution 
of a nonsmooth system of equations. It is shown that a semi-smooth Newton method applied to 
this nonsmooth system of equations is always well defined and under a mild assumption on the 
simplicial cone the method generates a sequence that converges linearly to its solution. Besides, 
we also show that the generated sequence is bounded for any starting point and a formula for 
any accumulation point of this sequence is presented. The presented numerical results suggest 
that this approach achieves accurate solutions to large problems in few iterations. 
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1 Introduction 

The purpose of this paper is to motivate and describe a new approach for solving a special class 
of constrained convex quadratic programming problems, namely, simplicial cone constrained ones, 
by using the semi-smmooth Newton’s method, and to present the results of some computational 
experiments designed to investigate its practical viability. 

Simplicial cone constrained convex quadratic programming arises as an important problem in 
its own right, it has an important subclass of positively constrained convex quadratic programming, 
namely, the positively constrained least-squares problems, or equivalently the problem of projecting 
the point onto a simplicial cone. The interest in the subject of projection arises in several situations, 
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having a wide range of applications in pure and applied mathematics such as Convex Analysis 
(see e.g. [T6]). Optimization (see e.g. MEWS1EIU3I!), Numerical Linear Algebra (see e.g. E23), 
Statistics (see e.g. [sumnzi), Computer Graphics (see e.g. [14] ) and Ordered Vector Spaces (see 
e.g. [UtlSUMZa-ES]). More specifically, the projection onto a polyhedral cone, which has as a special 
case the projection onto a simplicial one, is a problem of high impact on scientific communitjEl. The 
geometric nature of this problem makes it particularly interesting and important in many areas of 
science and technology such as Statistics (see e.g. cm Computation (see e.g. |18]L Optimization 
(see e.g. [24J[33]) and Ordered Vector Spaces (see e.g. [27]). 

The projection onto a general simplicial cone is difficult and computationally expensive, this 
problem has been studied e.g. in [21I121I15II261I271I34) . It is a special convex quadratic program and its 
KKT optimality conditions consists in a linear complementarity problem (LCP) associated with it, 
see e.g ESJjMS]. Therefore, the problem of projecting onto simplicial cones can be solved by active 
set methods [41 12T11271125] or any algorithms for solving LCPs, see e.g mm and special methods 
based on its geometry, see e.g [25j[26]. Other fashionable ways to solve this problem are based 
on the classical von Neumann algorithm (see e.g. the Dykstra algorithm mmm)- Nevertheless, 
these methods are also quite expensive (see the numerical results in [24] and the remark preceding 
section 6.3 in [53]). 

The KKT optimality conditions of simplicial cone constrained convex quadratic programming 
consist in a linear complementarity problem. Under a suitable condition, this leads to an equivalence 
between the simplicial cone constrained convex quadratic programming problem and the one of 
finding the unique solution of a nonsmooth system of equations. It is worth pointing out that a 
similar equation has been studied by Mangasaria in [23], which have used the semi-smooth Newton 
method for solving that equation, namely, an absolute value equation. Following the idea of [23], 
we apply the semi-smooth Newton’s method, see [30j, to find a unique solution of the associated 
nonsmooth system of equations, which generates the solution of the simplicial cone constrained 
convex quadratic programming. Under a mild assumption on the simplicial cone we show that 
the method generates a sequence that converges linearly to the solution of the associated system of 
equations. This new approach has potential advantages over existing methods. The main advantage 
appears to be the ability to achieve accurate solutions to large problems in relatively few iterations. 
The global and linear convergence properties partially explain this good behavior. Our numerical 
results suggest that for a given problem class, the number of required iterations is almost unchanged. 
The numerical results also indicate a remarkable robustness with respect to the starting point. 

The organization of the paper is as follows. In Section fl. 11 some notations and basic results used 
in the paper are presented. In the beginning of Section [2] our main problem, the simplicial cone 
constrained convex quadratic programming problem, is presented. In Section 12.11 a semi-smooth 
equation is presented whose any solution generates a solution of our convex quadratic programming 
problem and an existence and uniqueness result of the solution for this semi-smooth equation is 
obtained. In Section 12.21 we state and prove a convergence theorem on the semi-smooth Newton 
method for finding the solution of the semi-smooth equation associated to the simplicial cone 
constrained convex quadratic programming problem. In Section [3] we present some computational 
tests. 

1 see the popularity of the Wikimization page Projection on Polyhedral Cone at 
http://www.convexoptimization.eom/wikimization/index.php/Special:Popularpages 
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1.1 Notations and auxiliary results 

In this subsection we fix the notations and presend some auxiliary results used throughout the 
paper. Let R n denote the n-dimensional Euclidean space and let (•, •) be the canonical scalar 
product and || • || be the norm generated by it. The z-tli component of a vector x € R ra is denoted 
by x t for every i = 1 ,,n. Define the nonnegative orthant as 

M" := {x £ R n : Xi > 0 , j = 1,..., n}. 

For x £ R n , sgn(x) will denote a vector with components equal to 1, 0 or —1 depending on whether 
the corresponding component of the vector x is positive, zero or negative. If a £ R and x £ R n , then 
denote a + := max{a,0}, a~ := max{—a,0} and x + , x~ and |x| the vectors with z-th component 
equal to (xj) + , ( xf)~ and \xi\, respectively. From the definitions of x + and x~ it easy to conclude 
that 

x = x + — x~, x + £ R" , x“ £ R+, (x + ,x _ )=0, V x £ R n . (1) 


Remark 1 It is well know that the projection onto a convex set is continuous and nonexpansive, 
see m ■ Since the projection of the point x £ R n onto the nonnegative orthant is x + , we conclude 
that || z + — u> + || < ||z — zu||, for all z,w £ M n . 

The set of all m x n matrices with real entries is denoted by R mxn and M n = M nxl . The matrix 
/ denotes the n x n identity matrix. If x £ M n then diag(x) will denote an n x n diagonal matrix 
with (z,z)-th entry equal to Xi, i = 1 For an M £ M nxn consider the norm defined by 

||M|| := max a , 7 io{||-^ ;:c ll : x £ ll x ll = !}• This definition implies 

||Mx||<||M||||x||, ||LM||<||L||||M||, (2) 


for any matrices L,M £ M nxn . 

Lemma 1 (Banach’s Lemma) Let E £ R nxn and I the n x n identity matrix. If ||F|| < 1, then 
E — I is invertible and || (E — I)~ L || < 1/ (1 — ||F||) . 

We will call a closed set K C M n with nonempty interior a cone if the following conditions hold: 

(i) Ax + fiy £ K for any A, y > 0 and x, y £ I\ , 

(ii) x, —x £ K implies x = 0. 

Let K C M n be a cone. The dual cone of K is the following set 

K* := {x £ R n | (x, y) > 0,Vy £ K}. 

The simplicial cone associated to a nonsingular matrix A £ R nxn is defined by 

ylR" := {Ax : x £ Wf}, (3) 

The following result follows from the definition of the dual of a cone. For a proof see for example p]. 
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Lemma 2 Let A be an n x n nonsingular matrix. Then, 

(AM”)* = (A T )~ 1 R r f. 

We will need the following result, for a proof combine Proposition 2A.3 with Theorem 2A.6 of [TO]. 

Theorem 1 Let : M” —>• M be a differentiable convex function and K be a closed, convex cone in 
M”. Then x is a solution of the problem 


Minimize <p(x) 
subject to x £ K, 

if and only if x satisfies the following optimality conditions 

x £ K, Vip(x) £ K*, (Vip(x), x) = 0. 

We end this section with the basic contraction mapping principle, its proof can be found in of m 
(see Theorem 1A.3 page 15). 

Theorem 2 (basic contraction mapping principle) Let X be a complete metric space with 
metric p and let f> : X —> X. Suppose that there exists A £ [0,1) such that p((f(x), 4>(y)) < ap(x,y), 
for all x, y £ X. Then there exists an unique x £ X such that (j)(x) = x 


2 Quadratic programming under a simplicial cone constraint 


In this section we will present a semi-smooth Newton method for solving a special class of quadratic 
programming problems, namely, quadratic programming problems under a simplicial cone con¬ 
straint. The statement of such a problem is: 


Problem 1 (quadratic programming problem under a simplicial cone constraint) Let Q £ 

M nxn be a symmetric positive definite matrix, b £ R n ; c€l and A £ M nxn a nonsingular matrix. 
Find a solution u of the convex programming problem 


Minimize —x T Qx + x T b + c 
subject to x £ AM”. 


(4) 


Let us present an important particular case of Problem [T] 

Example 1 Given A £ M nxn a nonsingular matrix and z £ M n . The projection Par^(^) of the 
point z onto the cone AM” is defined by 


Pawl™(z) := argmin 



ye 
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From the definition of the simplical cone associated with the matrix A in (f3j) , the problem of pro¬ 
jecting the point z £ R" onto a simplicial cone AM” may be stated as the following positively 
constrained quadratic programming problem 

Minimize — 11 z — Ax 11 2 , 
subject to x £ R”. 


Hence, if v £ M n is the unique solution of this problem then we have Pam™(z) = Av. The above 
problem is equivalent to the following nonegatively constrained quadratic programming problem 


Minimize — x T Qx + x^b + c 
subject to x £ R”, 


(5) 


by taking Q = A T A, b = — A T z and c = zJ z/ 2. The optimality condition for problem Q implies 
that its solution can be obtained by solving the following linear complementarity problem 

y — Qx = b, x > 0, y > 0, (x, y) = 0. (6) 


It is easy to establish that corresponding to each nonnegative quadratic problems © and each 
linear complementarity problems ([6]) associated to symmetric positive definite matrices, there are 
equivalent problems of projection onto simplicial cones. Therefore, the problem of projecting onto 
simplicial cones can be solved by active set methods QEL J2I0I2F or an V algorithms for solving 
LCPs, see e.g wm and special methods based on its geometry, see e.g l25[\Wj . Other fashionable 
ways to solve this problem are based on the classical von Neumann algorithm (see e.g. the Dykstra 
algorithm MMW). Nevertheless, these methods are also quite expensive (see the numerical results 
in \2$ and the remark preceding section 6.3 in mb 

In the next section we will show that Problem |T] can be solved by finding a solution of a special 
semi-smooth equation. 


2.1 The semi-smooth equation associated to quadratic programming 

In this section we present a semi-smooth equation whose any solution generates a solution of 
Problem [I] 

Problem 2 (semi-smooth equation) Let Q £ R nxn be a symmetric positive definite matrix, 
b £ R n , c £ R and A £ R”^” a nonsingular matrix. Find a solution u of the semi-smmoth equation 


A t QA - I 


x + + x + A T b = 0. 


(7) 


Next we apply Theorem[l]for showing that a solution of Problem [2] generates a solution of ProblemO] 


Proposition 1 If the vector u is a solution of Problem^ then Au + is a solution of Problem\7\ 
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Proof. Note that from ([T]) we have u + — u = u~ for all u G R”. Thus, if u G R” is a solution of 
Problem [21 then 

A t ( QAu + + 6) = u~. 

Since A is a nonsingular matrix and u~ G R”, it follows from the last equality that 

QAu + + b = ( A T )~ l u~ G (A t )- 1 M" . 

Hence, by using Lemma[2]and (u~,u + ) = 0, the last inclusion easily implies that 

QAu + + b€ (HR” )*, {QAu + + b, Au + ) = 0. 

Therefore, as Au + € HR”, applying Theorem [T] with K = HR” and <p(x) = x T Qx/2 + x T b + c , 
the desired result follows. □ 


Proposition 2 Let AgR. If\\A T QA-l\\ < A < 1 then Problem® has a unique solution. 


Proof. The Problem [2] has a solution if only if the function <f>(x) = — [H t QH — /] x + — A T b, has 
a fixed point. From the definition of the function cj) and (1131) . it follows that for all G R” we 
have 


<t>(x) ~ <t>(v) = [ ~ A r QA — I diag (sgn((y + t(x — y)) + )) {x — y)dt. 
Jo 1 


Since ||diag(sgn((y + t{x — y))~ 
implies that 


< 1 and \\A t QA — 1 1| < A < 1 for all t G [0,1], the last equality 


110(a) - 0(2/) II < A||s ~y\\, v x,y G R n . 


Hence <j> is a contraction. Therefore applying Theorem [2] with X = R” and p = ||.|| we conclude that 
<f> has precisely a unique fixed point and consequently Problem [2] has precisely a unique solution. 
□ 


2.2 Semi-smooth Newton method 

In this section our goal is to state and prove a convergence theorem on the semi-smooth Newton 
method for finding the solution of Problem [21 We will first prove the well-definedness of the 
sequence generated by the semi-smooth Newton method. Then, under suitable conditions, the 
Q-linear convergence will be established. We also give a condition for the Newton method to finish 
in a finite number of iterations. Finally, we show that the semi-smooth sequence generated by the 
Newton method is bounded and we give a formula for any accumulation point of it. The statement 
of the main theorem is: 


Theorem 3 Let Q G R nx ” be a symmetric positive definite matrix, b G R”, c G R and A G R nxn 
a nonsingular matrix. Then, the sequences {xk} generated by the semi-smooth Newton Method for 
solving Problem ® 


%k-hl — 


A r QA - I 


diag(sgn{x ~^)) + I j A T b, 


( 8 ) 
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for k = 0,1,..., is well defined for any starting point xq E M n . Moreover, if 


A QA — I <1/2, Yxel”, (9) 

then the sequence { xk} converges Q-linearly to u E M n , the unique solution of Problem^ as follows 

\\a t qa-i\\ 


\U - Zfc+l|| < 


1 - \\A T QA - I 
As a consequence, Au + is the solution of the Problem^ 


u-x k ||, A: = 0,1,..., 


( 10 ) 


Henceforward we assume that all assumptions in Theorem[3]hold. The semi-smooth Newton method , 
see [30], for solving the Problem (2] i.e., for finding the zero of the function 


F(x) 


A t QA - I 


x + + x + A J b. 


( 11 ) 


with starting point xq E M n , is formally defined by 


F(x k ) + V k (x k +i - x k ) = 0, Vk E dF(xk), k = 0,1,..., (12) 


where 14 is any subgradient in dF{xk) the Clarke generalized Jacobian of F at Xk- Note that S(x), 
a subgradien in the Clarke generalized Jacobian of the function F at x (see Definition 2.6.1 on page 
70 of [8]), is given by 


S(x) := A r QA — I diag(sgn(.T + )) + I E dF(x), 


x € 


(13) 


Since diag(sgn(x + ))x = x + for all x E M n , taking into account (HIT) and (fl3l) . we conclude that 
S(x)x = F(x) — A T b. Thus, taking 14 = S(xk), equation (THZD becomes 

S(x k )x k +i = -A T b, k = 0,1,..., (14) 


which is an equivalente definition of semi-smooth Newton sequence for solving the senri-smooth 
Problem [2] i.e., equation ([8]), which formally defines a sequence {xk} with starting point .To E R n . 
Hence, the sequence {t/~} defined in (JHJ) will be called semi-smooth Newton sequence for finding the 
zero of the function F defined in (HID , or equivalently for solving the senri-smooth Problem [2] 


Lemma 3 The matrix S{x) defined in (11311 is nonsingular for all x E M™. As a consequence, the 
semi-smooth Newton sequence {x^} is well-defined, for any starting point xq E M n . 


Proof. Let x E R n . To simplify the notations let D = diag(sgn(x + )). 
becomes 



QA-I 


D + L 


Thus, the matrix in S(x) 


Let us suppose, by contradiction, that this matrix is singular, i.e, there exists u E M n such that 


A t QA - I 


D + I 


^ u = 0, u 4 0- 
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It is straightforward to see that the last formula is equivalent to 


A T QADu = (D — I)u, u^O. 


(15) 


Since the matrix Q is symmetric and positive definite, there exists a nonsingular matrix L £ R nxn 
such that Q = LL T . Taking into account that D 2 = D and Q = LL T , the equality in equation 
(TH)1) easily implies that 


L 1 ADu 


(dA t QADu,u^ = {{D 2 - D)u,u ) = 0. 


Thus we have L T ADu = 0. As Q = LL T and L T ADu = 0, equation (1151) implies that ( D — I)u = 0, 
or equivalently, Du = u. Hence 


L t Au = L 1 ADu = 0, u 0. 


But this contradicts the nonsingularity of A, since L is nonsingular. Therefore, the matrix S{x ) is 
nonsingular for all x £ 1" and the first part of the lemma is proven. 

The proof of the second part of the lemma is an immediate consequence of the definition of the 
semi-smooth Newton sequence { x in ([S]), the definition of S(x) in (fT3D . and the first part of the 
lemma. □ 


Lemma 4 Let S{x) be as defined in (fliil) . If ||A t QA — /|| < 1 for all x £ 

1 


then 


||5(x) 


-ii 


< 


V x £ 


l-\\A^QA-I\y 

Proof. To simplify the notation take S(x) = —(E — I), where the matrix E is defined by 


E = 


I — A t QA diag(sgn(x + )). 


Since the diagonal matrix diag(sgn(x + )) has components equal to 1 or 0, the definition of E and 
the assumption ||yl T (5A — /|| < 1 implies that 


||£|| < \\A t QA-I\\ < 1. 


Therefore, as S(x) = —(E — I), combining the last inequality with Lemma Q] and the definition of 
E, the desired inequality follows. □ 


Lemma 5 Let F be the function defined in (HD and S(x) be the matrix defined in (fT3l) . Then the 
following inequality holds: 

||S(x) - S(y )|| < \\A t QA - I||, V x,y £ R n . 

As a consequence, 

II F(x) - F{y) - S(y)(x - y )|| < ||A T QA - I||||x - y\\, 
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Vi,j/£ M™. 









Proof. Let x,y £ M n . The definition in (11311 implies that 

\\S(x) - S(y )|| = \\A t QA - I|| ||diag(sgn(x + )) - diag(sgn(y+))|| < WA^QA - 1 ||, 

which is the first inequality of the lemma. For proving the second inequality of the lemma, note 
that the definitions in (fTTT) and (fTUl) imply 

F{x) - F(y) - S(y)(x - y) = [ [S(y + t(x - y)) - S{y)\ (x - y)dt. 

Jo 

Therefore, the result follows by taking the norm in both sides of the last equality and using the 
first part of the lemma. □ 


Finally, we are ready to prove the main result, namely, Theorem [3j 

Proof of Theorem 3. The well-definedeness, for any starting point xq £ M 71 , follows from 
Lemma [3l Using Proposition [2l we conclude that under assumption ([9]) Problem [2] has unique 
solution u £ K”. 

Let F be the function defined in (11111 and S{x) be the matrix defined in (11311 . Since u £ M n is 
the solution of Problem[2]we have F(u) = 0, which together with definition of {:£&} in ([8]) implies 

u - x k+ i = [F(u) - F(x k ) - S(x k ){u - x k )], k = 0,1,.... 

Using properties of the norm in ([2]), last equality implies 

11^ - Zfc+i|| < ||‘S’(®fc)^ 1 |l \\l F ( u ) ~ F ( x k ) - S(x k )(u - x fc )]||, k = 0,1,.... 


Combining Lemma [5] with the second part of Lemma [5l we conclude from the last equality that 


II u - x fc+ i|| < 


\\A t QA-I || 
1- \\A T QA-I\ 


I u - x k \ 


k = 0,1,. 


(16) 


Since ||^4 T Q^4 — T|| < 1/2, we have \\A T QA — J||/(l — \\A T QA — 7||) < 1. Therefore, the inequality in 
(11611 implies that {x k } converges Q-linearly, from any starting point, to the solution u of Problem [2j 
Hence the first part of the theorem is proven. 

Since u £ K ra is the solution of Problem [2] the second part of the theorem follows by using 
Proposition [I] □ 


The next proposition gives a condition for the Newton iteration Q to finish in a finite number 
of steps. 

Proposition 3 If in (jHj) it happens that sgn(x^ +1 ) = sgn(x^), then x k +i is a solution of Problem^ 
and Ax~jj, 1 is the solution of the Problem [7J 

Proof. If sgn(x/, 1 ) = sgn(x/") in equation then it becomes 



diag(sgn(x+ fl )) + /} x k+1 


= -A T b. 


(17) 
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Since diag(sgn(xjj" +1 ))xfc+i = x~l +v the last equality yields 


A t QA - I x+ +1 + x k+ i = -A T b, 


which implies that x^+i is a solution of Problem [5] and, by using Proposition [fl it follows that 
Ax t+ 1 is the solution of the Problem |T] □ 


The next proposition shows that the semi-smooth Newton sequence {x^}, defined in ((HJ), is 
bounded and gives a formula for any accumulation point of it, without assuming condition (f9|). 

Proposition 4 The semi-smooth Newton sequence {x^}, defined in ©, is bounded from any start¬ 
ing point. Moreover, for each accumulation point x of {xk} there exists an x £ M n such that 

i^A 1 QA — I'j diag{sgn(x + )) + x = — A T b. (18) 

In particular, if sgn(x + ) = sgn(x + ), then x is a solution of Problem d and Ax + is the solution of 
Problem. [7J 

Proof. Suppose to the contrary that { x a} is unbounded. Note that, as there are only finitely many 
vectors sgn(x)!") with coordinates 0 or 1, there exists a vector x £ M m and a subsequence {x^} of 
{xfc} such that 

sgn(x^,) = sgn(x + ). 

Now, since {x^} is unbounded and the unit sphere is compact, there exists a vector v £ M m and a 
subsequence {x^} of {x^} such that 

lim ||xt.+i|| = oo, lim fcj+1 = v 0. (19) 

Therefore, as sgn(x^ ) = sgn(x + ) for all j, the definition of the semi-smooth Newton sequence {x^} 
in (1141) implies 

((^ - /) diag(sgn(i+)) + /) ^ j = 0. 1,2. 

By tending with j to infinity in the above equality and by taking into account (1191) , it follows that 

(^AJQA - I'j diag(sgn(x + )) + ij v = 0, 

which contradicts the first part of the Lemma [3] since v / 0, Therefore, the sequence {x^} is 
bounded, which proves the first part of the proposition. 

For proving the second part of the proposition, let x be an accumulation point of the sequence 
{xfc}. Then, since there are only finitely many vectors sgn(x^") with coordinates 0 or 1, there exists 
a vector x € M m and a subsequence {x^} of {x^} such that 

lim Xfc.+i = x, sgn(xt) = sgn(x + ), 

?—>-oo j 
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Since sgn(x^.) = sgn(x + ) for all j. the definition of the semi-smooth Newton sequence {x k } in © 
implies 

( (a t QA - diag(sgn(x + )) + /) x kj+ i = -A T b, j = 0,1,2,.... 

Taking the limit in the last equality as kj goes to oo , the second part of the proposition follows. 

Finally, for proving last part of the proposition, use the assumption sgn(x + ) = sgn(x + ) and 
(fl8l) to obtain 

(JyAJQA — I^J diag(sgn(x + )) + /) x = — A T b. 

Therefore, taking into account that diag(sgn(x + ))x = x + it is easy to conclude from the above 
equality that x + is a solution of Problem [2] and, by using Proposition |TJ we obtain that Ax + is the 
solution of the Problem [1] which conclude the proof of the proposition. □ 


3 Computational results 

In this section we test our semi-smooth Newton method © to find solutions on generated random 
instances of Problem [21 We present two types of experiments. In one of them, we guarantee that 
for each test problem the hypotheses given in Theorem [3] are satisfied and in the other they are 
not. 

All programs were implemented in MATLAB Version 7.11 64-bit and run on a 3A0GHz Intel 
Core i5 — 4670 with 8.0 GB of RAM. All MATLAB codes and generated data of this paper are 
available in http://orizon.mat.ufg.br/pages/34449-publications. 

All experiments are based on the following general considerations: 

• In order to accurately measure the method’s runtime for a problem, each one of the test prob¬ 
lems was solved 10 times and the runtime data collected. Then, we defined the corresponding 
method's runtime for a problem as the median of these measurements. 

• Let Tol X € M + be a relative bound, we consider that the method converged to the solution 
and stopped the execution when, for some k, the condition 

||u — x k \\ < Tol X(1 + |M|), 

is satisfied. If the previous stopping criteria are not met within 100 iterations, we declare 
that the method did not converge. 

3.1 When the hypotheses of Theorem [3] are satisfied 

In this experiment, we studied the behavior of the method on sets of 100 randomly generated 
test problems of dimension n = 2000, 3000,4000, 5000, respectively. Furthermore, we analyzed the 
influence of the initial point in the convergence of the method on 1000 randomly generated test 
problems of dimension = 100. For each test problem in this experiment the hypotheses given in 
the Theorem [3] are satisfied, generating each of them as follows: 
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(i) To construct the matrices A,Q £ M n><n satisfying the assumption © in Theorem [3l we 
first chose a random number f3 from the standard uniform distribution on the open interval 
(0,1/2). Secondly, we compute the symmetric positive definite matrix Q = B T B, where B is 
a generated n x n real nonsingular matrix containing random values drawn from the uniform 
distribution on the interval [—10 6 ,10 6 ]. Then, we compute the matrices S,V and D, respec¬ 
tively, from the singular value decomposition of a generated n x n real nonsingular matrix 
containing random values drawn from the uniform distribution on the interval [—10 6 ,10 6 ]. 
Finally, we compute the matrix A from the system of linear equations 

BA = S sqrt ( / + 


Pi 


a 


V D, 


were a is the largest singular value of V and sqrt (I + ^V) is the square root of the diagonal 
matrix I + — V. 

(7 

(ii) We have chosen the solution u £ M ra containing random values drawn from the uniform 
distribution on the interval [— 10 e , 10 6 ] and then we have computed b £ M n from equation (j7|). 

(iii) Finally we have chosen a starting point xq £ containing random values drawn from the 
uniform distribution on the interval [—10 6 ,10 6 ]. 


In accordance with the theoretical convergence of the method, ensured by Theorem [3l the 
computational convergence is obtained in all cases. 

The computational results to analyze the behavior of the method on sets of 100 generated 
random test problems of different dimensions, are reported in Table [TJ From these, it can be 
noted that for the same dimension, to achieve higher accuracy, the method does not experience a 
significant increase in the number of iterations or in runtime. On the other hand, the increase in the 
dimension of the problems does not necessarily involve an increase in the number of iterations to 
achieve the same accuracy, however, a larger runtime is consumed. A larger runtime consumption is 
associated with the fact that the semi-smooth Newton method © requieres the solution of a linear 
system in each iteration, whose computational effort increases with the dimension of the problem. 
Another important aspect that can be checked in Table [T] is the ability of the method to converge 
in about three iterations on average. 


n 

Total Iterations 

Total Time 

2000 

284 

299 

300 

334.243 

351.823 

352.922 

3000 

279 

293 

295 

1064.158 

1117.909 

1124.941 

4000 

281 

303 

303 

2481.145 

2676.010 

2674.550 

5000 

283 

303 

305 

4927.101 

5261.154 

5142.072 

TolX 

10” 6 

10" 8 

IQ" 10 

10 -6 

10~ 8 

io - 10 


Table 1: Total overall iterations and total time in seconds, performed and consumed, respectively by 
the semi-smooth Newton method © to solve the 100 test problems of each dimension for different 
accuracies. 
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In order to study the influence of the initial point in the convergence of the method, we have 
generated 1000 test problems of dimension n = 100 and we have associated to each of them 1000 
generated initial points. We have solved each problem with each of the 1000 corresponding initial 
points. Then, we have computed the standard deviation (STD) d{ and the mean value (MEAN) 
rfii of the number of iterations performed by the method to solve the problem i taking each one 
of the 1000 initial points. Finally we have computed the mean of all di and the mean of all 
mi, i = 1,..., 1000. All cases converged, indicating robustness of the method with respect to the 
starting point. The results are shown in Table[2j The standard deviation of the number of iterations 
performed by the method to solve the problem i with the 1000 initial points gives us an idea of the 
influence of the initial point in the number of iterations performed by the method in each problem. 
The reported means of these standard deviation values give us an idea of the influence of the initial 
point in the number of iterations performed by the method in all the problems in general. The 
results in the table show that on average the number of iterations performed by our method to find 
the solution for a problem varies only very slightly with the chosen starting point. Again we see 
that the average number of iterations performed is less than three. 


Tol X 

MEAN ({di}j=i,...,iooo) 

MEAN ({m.j}j = i ) ... i iooo) 

10 -6 

0.241 

2.337 

10" 8 

0.249 

2.348 

10~ 10 

0.249 

2.348 


Table 2: Influence of the initial point in the convergence of the semi-smooth Newton method (JHJ) 
on a total of 1000 test problems of dimension n = 100 each of them with 1000 generated initial 
points for different accuracies. 


3.2 When the hypotheses of Theorem [3] are not satisfied 

In this experiment, we studied the behavior of the method on 1000 test problems of dimension 
n = 100, where the hypotheses given in the Theorem [3] are not all satisfied. 

In this case, the test problems were built almost as in the previous experiment. The only 
difference was in the construction of the matrices A, Q € W lXn not satisfying the assumption ([9]) 
of Theorem [3j Namely, we chose the random number (3 from the standard uniform distribution on 
the interval [lb,ub), where \ <lb < ub. Then, || A T QA — J|| = (3. 

According to the obtained numerical results, we can conjecture that our method converges to a 
much broader class of problems, not satisfying the hypotheses of Theorem [3j However we detected 
that convergence with high accuracy to the solution largely depends on the magnitude of the value 
of the norm in condition Q. This idea can be observed inspecting Table [2 As the magnitude of 
the value of the norm in @ increases, the number of problems for which the method converges 
decreases, and decreases the number of problems for which the method converges to the solution 
with greater accuracy. It can be also seen that for the same value of the norm in ([9]), the number 
of problems for which the method converges with greater precision reduces. This phenomenon, of 
course, is not associated to the convergence of the method for a specific problem, but, rather, there 
is an optimum accuracy achievable due to the accumulated errors. Small tolerances do not ensure 
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obtaining accurate results. It can be the case that convergence is overlooked and unnecessary 
iterations are performed. It is important to note in the table that, even when the hypothesis is 
unfulfilled, the method converges for these problems in an average of less than seven iterations, 
which means an increase of approximately four iterations with respect of the previous experiments 
in which the hypotheses were fulfilled. 


(3 £ [lb, ub) 

Solved Problems 

Iterations 

[0.5,10 3 ) 

1000 

1000 

994 

5.813 

5.813 

5.813 

[10 3 ,10 4 ) 

1000 

1000 

966 

6.318 

6.318 

6.316 

[10 4 ,10 5 ) 

1000 

995 

539 

6.389 

6.389 

6.455 

[10 5 ,10 6 ) 

1000 

964 

3 

6.436 

6.438 

6 

[10 6 ,10 7 ) 

995 

547 

0 

6.467 

6.497 

- 

[10 7 ,10 8 ) 

960 

3 

0 

6.436 

6.667 

- 

Tol X 

10~ 6 

10" 8 

10-io 

10" 6 

10“ 8 

10-io 


Table 3: Number of problems solved by the semi-smooth Newton method d8j) on a total of 1000 test 
problems of dimension n = 100 of each condition (lb < ||7l T (37l — /|| < ub ) for different accuracies, 
and the mean number of iterations performed by the semi-smooth Newton method ((HJ) to solve one 
problem in each case. 


4 Conclusions 

In this paper we studied a special class of convex quadratic programs, namely, simplicial cone con¬ 
strained convex quadratic programming problems, which, via its optimality conditions, is reduced 
to finding the unique solution of a nonsmooth system of equations. Our main result shows that, 
under a mild assumption on the simplicial cone, we can apply a semi-smooth Newton method for 
finding a unique solution of the obtained associated nonsmooth system of equations and that the 
generated sequence converges linearly to the solution for any starting point. It would be interesting 
to see whether the used technique can be applied for solving more general convex programs. 

Since the optimality condition of a simplicial cone constrained convex quadratic programming 
problem consists in a certain type of linear complementarity problem, which is equivalent to the 
problem of finding the unique solution of a nonsmooth system of equations, another interesting 
problem to address is to compare our semi-smooth Newton method with active set methods IT. I21: 

mm- 

This paper is a continuation of [12], where we studied the problem of projection onto a simplicial 
cone by using a semi-smooth Newton method. We expect that the results of this paper become a 
further step towards solving general convex optimization problems. We foresee further progress in 
this topic in the nearby future. 
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